2025-04-02 02:08:47,648 [ 63615 ] INFO : ClickHouse root is not set. Will use /home/ubuntu/_work/ClickHouse/ClickHouse (runner:53, check_args_and_update_paths) 2025-04-02 02:08:47,648 [ 63615 ] INFO : Cases dir is not set. Will use /home/ubuntu/_work/ClickHouse/ClickHouse/tests/integration (runner:97, check_args_and_update_paths) 2025-04-02 02:08:47,648 [ 63615 ] INFO : utils dir is not set. Will use /home/ubuntu/_work/ClickHouse/ClickHouse/utils (runner:108, check_args_and_update_paths) 2025-04-02 02:08:47,648 [ 63615 ] INFO : base_configs_dir: /home/ubuntu/_work/ClickHouse/ClickHouse/programs/server, binary: /home/ubuntu/_work/_temp/test/build/clickhouse, cases_dir: /home/ubuntu/_work/ClickHouse/ClickHouse/tests/integration (runner:110, check_args_and_update_paths) clickhouse_integration_tests_volume Running pytest container as: 'docker run --rm --name clickhouse_integration_tests_tnvh71 --privileged --dns-search='.' --memory=30709030912 --security-opt seccomp=unconfined --cap-add=SYS_PTRACE --volume=/home/ubuntu/_work/_temp/test/build/clickhouse-odbc-bridge:/clickhouse-odbc-bridge --volume=/home/ubuntu/_work/_temp/test/build/clickhouse:/clickhouse --volume=/home/ubuntu/_work/_temp/test/build/clickhouse-library-bridge:/clickhouse-library-bridge --volume=/home/ubuntu/_work/ClickHouse/ClickHouse/programs/server:/clickhouse-config --volume=/home/ubuntu/_work/ClickHouse/ClickHouse/tests/integration:/ClickHouse/tests/integration --volume=/home/ubuntu/_work/ClickHouse/ClickHouse/utils/backupview:/ClickHouse/utils/backupview --volume=/home/ubuntu/_work/ClickHouse/ClickHouse/utils/grpc-client/pb2:/ClickHouse/utils/grpc-client/pb2 --volume=/run:/run/host:ro --volume=clickhouse_integration_tests_volume:/var/lib/docker -e DOCKER_DOTNET_CLIENT_TAG=11de0b29a15d -e DOCKER_HELPER_TAG=5dc43a6382f0 -e DOCKER_BASE_TAG=8b2301119731 -e DOCKER_KERBEROS_KDC_TAG=9391ecdee8d7 -e DOCKER_MYSQL_GOLANG_CLIENT_TAG=9bec2a638e6e -e DOCKER_MYSQL_JAVA_CLIENT_TAG=766bff31cfe4 -e DOCKER_MYSQL_JS_CLIENT_TAG=41ba7c2ec2a1 -e DOCKER_MYSQL_PHP_CLIENT_TAG=88be89c1e3b6 -e DOCKER_NGINX_DAV_TAG=b55ac9cd7519 -e DOCKER_POSTGRESQL_JAVA_CLIENT_TAG=a4eff5c7f4d6 -e DOCKER_PYTHON_BOTTLE_TAG=caad4729259e -e DOCKER_CLIENT_TIMEOUT=300 -e COMPOSE_HTTP_TIMEOUT=600 -e PYTHONUNBUFFERED=1 -e PYTEST_ADDOPTS="--dist=loadfile -n 10 -rfEps --run-id=0 --color=no --durations=0 test_accept_invalid_certificate/test.py::test_accept test_accept_invalid_certificate/test.py::test_connection_accept test_accept_invalid_certificate/test.py::test_default test_accept_invalid_certificate/test.py::test_strict_connection_reject test_accept_invalid_certificate/test.py::test_strict_reject test_accept_invalid_certificate/test.py::test_strict_reject_with_config test_alter_comment_on_cluster/test.py::test_comment 'test_alter_moving_garbage/test.py::test_alter_moving[False-False]' 'test_alter_moving_garbage/test.py::test_alter_moving[False-True]' 'test_alter_moving_garbage/test.py::test_alter_moving[True-True]' test_alter_moving_garbage/test.py::test_delete_race_leftovers test_async_insert_memory/test.py::test_memory_usage test_asynchronous_metric_jemalloc_profile_active/test.py::test_asynchronous_metric_jemalloc_profile_active test_asynchronous_metric_log_table/test.py::test_event_time_microseconds_field test_asynchronous_metrics_pk_bytes_fields/test.py::test_total_pk_bytes_in_memory_fields 'test_attach_backup_from_s3_plain/test.py::test_attach_part[compact0]' 'test_attach_backup_from_s3_plain/test.py::test_attach_part[compact1]' 'test_attach_backup_from_s3_plain/test.py::test_attach_part[wide0]' 'test_attach_backup_from_s3_plain/test.py::test_attach_part[wide1]' test_attach_without_checksums/test.py::test_attach_without_checksums test_azure_blob_storage_native_copy/test.py::test_backup_restore_on_merge_tree_different_container test_azure_blob_storage_native_copy/test.py::test_backup_restore_on_merge_tree_native_copy_async test_azure_blob_storage_native_copy/test.py::test_backup_restore_on_merge_tree_same_container test_backup_restore_azure_blob_storage/test.py::test_backup_restore test_backup_restore_azure_blob_storage/test.py::test_backup_restore_correct_block_ids test_backup_restore_azure_blob_storage/test.py::test_backup_restore_diff_container test_backup_restore_azure_blob_storage/test.py::test_backup_restore_on_merge_tree test_backup_restore_azure_blob_storage/test.py::test_backup_restore_with_named_collection_azure_conf1 test_backup_restore_azure_blob_storage/test.py::test_backup_restore_with_named_collection_azure_conf2 test_backup_restore_on_cluster/test_concurrency.py::test_concurrent_backups_on_different_nodes test_backup_restore_on_cluster/test_concurrency.py::test_concurrent_backups_on_same_node 'test_backup_restore_on_cluster/test_concurrency.py::test_create_or_drop_tables_during_backup[Atomic-MergeTree]' 'test_backup_restore_on_cluster/test_concurrency.py::test_create_or_drop_tables_during_backup[Lazy-Log]' 'test_backup_restore_on_cluster/test_concurrency.py::test_create_or_drop_tables_during_backup[Memory-MergeTree]' 'test_backup_restore_on_cluster/test_concurrency.py::test_create_or_drop_tables_during_backup[Ordinary-MergeTree]' 'test_backup_restore_on_cluster/test_concurrency.py::test_create_or_drop_tables_during_backup[Replicated-ReplicatedMergeTree]' test_backup_restore_on_cluster/test_concurrency.py::test_kill_mutation_during_backup test_backup_restore_on_cluster/test_concurrency.py::test_replicated_table test_backup_restore_on_cluster/test_slow_rmt.py::test_replicated_database_async test_backup_restore_on_cluster/test_two_shards_two_replicas.py::test_replicated_table test_backup_restore_on_cluster/test_two_shards_two_replicas.py::test_two_tables_with_uuid_in_zk_path 'test_backup_restore_s3/test_throttling.py::test_backup_scheduler_settings[0-default]' 'test_backup_restore_s3/test_throttling.py::test_backup_scheduler_settings[0-s3_native_copy]' 'test_backup_restore_s3/test_throttling.py::test_backup_scheduler_settings[0-s3_no_native_copy]' 'test_backup_restore_s3/test_throttling.py::test_backup_scheduler_settings[1-default]' 'test_backup_restore_s3/test_throttling.py::test_backup_scheduler_settings[1-s3_native_copy]' 'test_backup_restore_s3/test_throttling.py::test_backup_scheduler_settings[1-s3_no_native_copy]' 'test_backup_restore_storage_policy/test.py::test_storage_policies[None--default]' 'test_backup_restore_storage_policy/test.py::test_storage_policies[None-None-default]' 'test_backup_restore_storage_policy/test.py::test_storage_policies[None-policy1-policy1]' 'test_backup_restore_storage_policy/test.py::test_storage_policies[policy1--default]' 'test_backup_restore_storage_policy/test.py::test_storage_policies[policy1-None-policy1]' 'test_backup_restore_storage_policy/test.py::test_storage_policies[policy1-policy1-policy1]' 'test_backup_restore_storage_policy/test.py::test_storage_policies[policy1-policy2-policy2]' test_backup_s3_storage_class/test.py::test_backup_s3_storage_class test_backward_compatibility/test.py::test_backward_compatability1 test_backward_compatibility/test_aggregate_fixed_key.py::test_two_level_merge test_backward_compatibility/test_aggregate_function_state.py::test_backward_compatability_for_avg 'test_backward_compatibility/test_aggregate_function_state.py::test_backward_compatability_for_uniq_exact[1000]' 'test_backward_compatibility/test_aggregate_function_state.py::test_backward_compatability_for_uniq_exact[500000]' 'test_backward_compatibility/test_aggregate_function_state.py::test_backward_compatability_for_uniq_exact_variadic[1000]' 'test_backward_compatibility/test_aggregate_function_state.py::test_backward_compatability_for_uniq_exact_variadic[500000]' test_backward_compatibility/test_ip_types_binary_compatibility.py::test_ip_types_binary_compatibility test_backward_compatibility/test_memory_bound_aggregation.py::test_backward_compatability test_backward_compatibility/test_parallel_replicas_protocol.py::test_backward_compatability test_backward_compatibility/test_short_strings_aggregation.py::test_backward_compatability test_block_structure_mismatch/test.py::test test_broken_projections/test.py::test_broken_ignored test_broken_projections/test.py::test_broken_ignored_replicated test_broken_projections/test.py::test_broken_on_start test_broken_projections/test.py::test_broken_projections_in_backups_2 test_broken_projections/test.py::test_broken_projections_in_backups_3 test_broken_projections/test.py::test_check_part_thread test_broken_projections/test.py::test_disappeared_projection_on_start test_broken_projections/test.py::test_materialize_broken_projection test_broken_projections/test.py::test_mutation_with_broken_projection 'test_checking_s3_blobs_paranoid/test.py::test_adaptive_timeouts[node]' 'test_checking_s3_blobs_paranoid/test.py::test_adaptive_timeouts[node_with_inf_s3_retries]' test_checking_s3_blobs_paranoid/test.py::test_exception_in_onFinish test_checking_s3_blobs_paranoid/test.py::test_no_key_found_disk test_checking_s3_blobs_paranoid/test.py::test_node_with_query_log_on_s3 test_checking_s3_blobs_paranoid/test.py::test_query_is_canceled_with_inf_retries test_checking_s3_blobs_paranoid/test.py::test_upload_after_check_works 'test_checking_s3_blobs_paranoid/test.py::test_upload_s3_fail_create_multi_part_upload[br]' 'test_checking_s3_blobs_paranoid/test.py::test_upload_s3_fail_create_multi_part_upload[bz2]' 'test_checking_s3_blobs_paranoid/test.py::test_upload_s3_fail_create_multi_part_upload[deflate]' 'test_checking_s3_blobs_paranoid/test.py::test_upload_s3_fail_create_multi_part_upload[gzip]' 'test_checking_s3_blobs_paranoid/test.py::test_upload_s3_fail_create_multi_part_upload[lz4]' 'test_checking_s3_blobs_paranoid/test.py::test_upload_s3_fail_create_multi_part_upload[none]' 'test_checking_s3_blobs_paranoid/test.py::test_upload_s3_fail_create_multi_part_upload[xz]' 'test_checking_s3_blobs_paranoid/test.py::test_upload_s3_fail_create_multi_part_upload[zstd]' 'test_checking_s3_blobs_paranoid/test.py::test_upload_s3_fail_upload_part_when_multi_part_upload[br]' 'test_checking_s3_blobs_paranoid/test.py::test_upload_s3_fail_upload_part_when_multi_part_upload[bz2]' 'test_checking_s3_blobs_paranoid/test.py::test_upload_s3_fail_upload_part_when_multi_part_upload[deflate]' 'test_checking_s3_blobs_paranoid/test.py::test_upload_s3_fail_upload_part_when_multi_part_upload[gzip]' 'test_checking_s3_blobs_paranoid/test.py::test_upload_s3_fail_upload_part_when_multi_part_upload[lz4]' 'test_checking_s3_blobs_paranoid/test.py::test_upload_s3_fail_upload_part_when_multi_part_upload[none]' 'test_checking_s3_blobs_paranoid/test.py::test_upload_s3_fail_upload_part_when_multi_part_upload[xz]' 'test_checking_s3_blobs_paranoid/test.py::test_upload_s3_fail_upload_part_when_multi_part_upload[zstd]' 'test_checking_s3_blobs_paranoid/test.py::test_when_error_is_retried[connection_refused]' -vvv -ss" altinityinfra/integration-tests-runner:2165613c5fcd '. Start tests ============================= test session starts ============================== platform linux -- Python 3.10.12, pytest-7.4.4, pluggy-1.5.0 -- /usr/bin/python3 cachedir: .pytest_cache Test order randomisation NOT enabled. Enable with --random-order or --random-order-bucket= rootdir: /ClickHouse/tests/integration configfile: pytest.ini plugins: timeout-2.3.1, repeat-0.9.3, order-1.0.0, reportlog-0.4.0, xdist-3.5.0, random-order-1.1.1 timeout: 900.0s timeout method: signal timeout func_only: False created: 10/10 workers 10 workers [100 items] scheduling tests via LoadFileScheduling test_checking_s3_blobs_paranoid/test.py::test_adaptive_timeouts[node] test_broken_projections/test.py::test_broken_ignored test_backup_restore_s3/test_throttling.py::test_backup_scheduler_settings[0-default] test_attach_backup_from_s3_plain/test.py::test_attach_part[compact0] test_backup_restore_storage_policy/test.py::test_storage_policies[None--default] test_backup_restore_azure_blob_storage/test.py::test_backup_restore test_accept_invalid_certificate/test.py::test_accept test_alter_moving_garbage/test.py::test_alter_moving[False-False] test_backup_restore_on_cluster/test_concurrency.py::test_concurrent_backups_on_different_nodes test_backward_compatibility/test_aggregate_function_state.py::test_backward_compatability_for_avg [gw5] PASSED test_accept_invalid_certificate/test.py::test_accept test_accept_invalid_certificate/test.py::test_connection_accept [gw5] PASSED test_accept_invalid_certificate/test.py::test_connection_accept test_accept_invalid_certificate/test.py::test_default [gw5] PASSED test_accept_invalid_certificate/test.py::test_default test_accept_invalid_certificate/test.py::test_strict_connection_reject [gw5] PASSED test_accept_invalid_certificate/test.py::test_strict_connection_reject test_accept_invalid_certificate/test.py::test_strict_reject [gw5] PASSED test_accept_invalid_certificate/test.py::test_strict_reject test_accept_invalid_certificate/test.py::test_strict_reject_with_config [gw5] PASSED test_accept_invalid_certificate/test.py::test_strict_reject_with_config [gw3] PASSED test_backup_restore_storage_policy/test.py::test_storage_policies[None--default] test_backup_restore_storage_policy/test.py::test_storage_policies[None-None-default] [gw3] PASSED test_backup_restore_storage_policy/test.py::test_storage_policies[None-None-default] test_backup_restore_storage_policy/test.py::test_storage_policies[None-policy1-policy1] [gw3] PASSED test_backup_restore_storage_policy/test.py::test_storage_policies[None-policy1-policy1] test_backup_restore_storage_policy/test.py::test_storage_policies[policy1--default] test_azure_blob_storage_native_copy/test.py::test_backup_restore_on_merge_tree_different_container [gw3] PASSED test_backup_restore_storage_policy/test.py::test_storage_policies[policy1--default] test_backup_restore_storage_policy/test.py::test_storage_policies[policy1-None-policy1] [gw3] PASSED test_backup_restore_storage_policy/test.py::test_storage_policies[policy1-None-policy1] test_backup_restore_storage_policy/test.py::test_storage_policies[policy1-policy1-policy1] [gw3] PASSED test_backup_restore_storage_policy/test.py::test_storage_policies[policy1-policy1-policy1] test_backup_restore_storage_policy/test.py::test_storage_policies[policy1-policy2-policy2] [gw3] PASSED test_backup_restore_storage_policy/test.py::test_storage_policies[policy1-policy2-policy2] test_backup_restore_on_cluster/test_two_shards_two_replicas.py::test_replicated_table [gw9] PASSED test_attach_backup_from_s3_plain/test.py::test_attach_part[compact0] test_attach_backup_from_s3_plain/test.py::test_attach_part[compact1] [gw7] PASSED test_backup_restore_s3/test_throttling.py::test_backup_scheduler_settings[0-default] test_backup_restore_s3/test_throttling.py::test_backup_scheduler_settings[0-s3_native_copy] [gw9] PASSED test_attach_backup_from_s3_plain/test.py::test_attach_part[compact1] test_attach_backup_from_s3_plain/test.py::test_attach_part[wide0] [gw6] PASSED test_backward_compatibility/test_aggregate_function_state.py::test_backward_compatability_for_avg [gw7] PASSED test_backup_restore_s3/test_throttling.py::test_backup_scheduler_settings[0-s3_native_copy] test_backup_restore_s3/test_throttling.py::test_backup_scheduler_settings[0-s3_no_native_copy] [gw9] PASSED test_attach_backup_from_s3_plain/test.py::test_attach_part[wide0] test_attach_backup_from_s3_plain/test.py::test_attach_part[wide1] [gw9] PASSED test_attach_backup_from_s3_plain/test.py::test_attach_part[wide1] [gw7] PASSED test_backup_restore_s3/test_throttling.py::test_backup_scheduler_settings[0-s3_no_native_copy] test_backup_restore_s3/test_throttling.py::test_backup_scheduler_settings[1-default] [gw2] PASSED test_broken_projections/test.py::test_broken_ignored test_broken_projections/test.py::test_broken_ignored_replicated [gw7] PASSED test_backup_restore_s3/test_throttling.py::test_backup_scheduler_settings[1-default] test_backup_restore_s3/test_throttling.py::test_backup_scheduler_settings[1-s3_native_copy] [gw7] PASSED test_backup_restore_s3/test_throttling.py::test_backup_scheduler_settings[1-s3_native_copy] test_backup_restore_s3/test_throttling.py::test_backup_scheduler_settings[1-s3_no_native_copy] [gw7] PASSED test_backup_restore_s3/test_throttling.py::test_backup_scheduler_settings[1-s3_no_native_copy] test_backward_compatibility/test_aggregate_function_state.py::test_backward_compatability_for_uniq_exact[1000] [gw8] PASSED test_alter_moving_garbage/test.py::test_alter_moving[False-False] test_alter_moving_garbage/test.py::test_alter_moving[False-True] [gw2] PASSED test_broken_projections/test.py::test_broken_ignored_replicated test_broken_projections/test.py::test_broken_on_start [gw1] PASSED test_backup_restore_on_cluster/test_concurrency.py::test_concurrent_backups_on_different_nodes test_backup_restore_on_cluster/test_concurrency.py::test_concurrent_backups_on_same_node [gw3] PASSED test_backup_restore_on_cluster/test_two_shards_two_replicas.py::test_replicated_table test_backup_restore_on_cluster/test_two_shards_two_replicas.py::test_two_tables_with_uuid_in_zk_path test_async_insert_memory/test.py::test_memory_usage [gw8] PASSED test_alter_moving_garbage/test.py::test_alter_moving[False-True] test_alter_moving_garbage/test.py::test_alter_moving[True-True] [gw0] PASSED test_checking_s3_blobs_paranoid/test.py::test_adaptive_timeouts[node] test_checking_s3_blobs_paranoid/test.py::test_adaptive_timeouts[node_with_inf_s3_retries] test_asynchronous_metric_log_table/test.py::test_event_time_microseconds_field [gw3] PASSED test_backup_restore_on_cluster/test_two_shards_two_replicas.py::test_two_tables_with_uuid_in_zk_path [gw6] PASSED test_backward_compatibility/test_aggregate_function_state.py::test_backward_compatability_for_uniq_exact[1000] [gw0] PASSED test_checking_s3_blobs_paranoid/test.py::test_adaptive_timeouts[node_with_inf_s3_retries] test_checking_s3_blobs_paranoid/test.py::test_exception_in_onFinish [gw8] PASSED test_alter_moving_garbage/test.py::test_alter_moving[True-True] test_alter_moving_garbage/test.py::test_delete_race_leftovers [gw0] PASSED test_checking_s3_blobs_paranoid/test.py::test_exception_in_onFinish test_checking_s3_blobs_paranoid/test.py::test_no_key_found_disk test_backward_compatibility/test_aggregate_function_state.py::test_backward_compatability_for_uniq_exact[500000] [gw2] PASSED test_broken_projections/test.py::test_broken_on_start test_broken_projections/test.py::test_broken_projections_in_backups_2 [gw0] PASSED test_checking_s3_blobs_paranoid/test.py::test_no_key_found_disk test_checking_s3_blobs_paranoid/test.py::test_node_with_query_log_on_s3 test_alter_comment_on_cluster/test.py::test_comment [gw7] PASSED test_asynchronous_metric_log_table/test.py::test_event_time_microseconds_field [gw0] PASSED test_checking_s3_blobs_paranoid/test.py::test_node_with_query_log_on_s3 test_checking_s3_blobs_paranoid/test.py::test_query_is_canceled_with_inf_retries test_asynchronous_metrics_pk_bytes_fields/test.py::test_total_pk_bytes_in_memory_fields [gw1] PASSED test_backup_restore_on_cluster/test_concurrency.py::test_concurrent_backups_on_same_node test_backup_restore_on_cluster/test_concurrency.py::test_create_or_drop_tables_during_backup[Atomic-MergeTree] [gw0] PASSED test_checking_s3_blobs_paranoid/test.py::test_query_is_canceled_with_inf_retries test_checking_s3_blobs_paranoid/test.py::test_upload_after_check_works [gw2] PASSED test_broken_projections/test.py::test_broken_projections_in_backups_2 test_broken_projections/test.py::test_broken_projections_in_backups_3 [gw0] PASSED test_checking_s3_blobs_paranoid/test.py::test_upload_after_check_works test_checking_s3_blobs_paranoid/test.py::test_upload_s3_fail_create_multi_part_upload[br] [gw0] PASSED test_checking_s3_blobs_paranoid/test.py::test_upload_s3_fail_create_multi_part_upload[br] test_checking_s3_blobs_paranoid/test.py::test_upload_s3_fail_create_multi_part_upload[bz2] [gw0] PASSED test_checking_s3_blobs_paranoid/test.py::test_upload_s3_fail_create_multi_part_upload[bz2] test_checking_s3_blobs_paranoid/test.py::test_upload_s3_fail_create_multi_part_upload[deflate] [gw6] PASSED test_backward_compatibility/test_aggregate_function_state.py::test_backward_compatability_for_uniq_exact[500000] [gw3] PASSED test_alter_comment_on_cluster/test.py::test_comment [gw0] PASSED test_checking_s3_blobs_paranoid/test.py::test_upload_s3_fail_create_multi_part_upload[deflate] test_checking_s3_blobs_paranoid/test.py::test_upload_s3_fail_create_multi_part_upload[gzip] [gw8] PASSED test_alter_moving_garbage/test.py::test_delete_race_leftovers [gw2] PASSED test_broken_projections/test.py::test_broken_projections_in_backups_3 test_broken_projections/test.py::test_check_part_thread [gw0] PASSED test_checking_s3_blobs_paranoid/test.py::test_upload_s3_fail_create_multi_part_upload[gzip] test_checking_s3_blobs_paranoid/test.py::test_upload_s3_fail_create_multi_part_upload[lz4] test_backward_compatibility/test_aggregate_function_state.py::test_backward_compatability_for_uniq_exact_variadic[1000] test_attach_without_checksums/test.py::test_attach_without_checksums [gw0] PASSED test_checking_s3_blobs_paranoid/test.py::test_upload_s3_fail_create_multi_part_upload[lz4] test_checking_s3_blobs_paranoid/test.py::test_upload_s3_fail_create_multi_part_upload[none] [gw2] PASSED test_broken_projections/test.py::test_check_part_thread test_broken_projections/test.py::test_disappeared_projection_on_start [gw0] PASSED test_checking_s3_blobs_paranoid/test.py::test_upload_s3_fail_create_multi_part_upload[none] test_checking_s3_blobs_paranoid/test.py::test_upload_s3_fail_create_multi_part_upload[xz] [gw0] PASSED test_checking_s3_blobs_paranoid/test.py::test_upload_s3_fail_create_multi_part_upload[xz] test_checking_s3_blobs_paranoid/test.py::test_upload_s3_fail_create_multi_part_upload[zstd] [gw0] PASSED test_checking_s3_blobs_paranoid/test.py::test_upload_s3_fail_create_multi_part_upload[zstd] test_checking_s3_blobs_paranoid/test.py::test_upload_s3_fail_upload_part_when_multi_part_upload[br] [gw0] PASSED test_checking_s3_blobs_paranoid/test.py::test_upload_s3_fail_upload_part_when_multi_part_upload[br] test_checking_s3_blobs_paranoid/test.py::test_upload_s3_fail_upload_part_when_multi_part_upload[bz2] [gw0] PASSED test_checking_s3_blobs_paranoid/test.py::test_upload_s3_fail_upload_part_when_multi_part_upload[bz2] test_checking_s3_blobs_paranoid/test.py::test_upload_s3_fail_upload_part_when_multi_part_upload[deflate] test_backup_s3_storage_class/test.py::test_backup_s3_storage_class [gw0] PASSED test_checking_s3_blobs_paranoid/test.py::test_upload_s3_fail_upload_part_when_multi_part_upload[deflate] test_checking_s3_blobs_paranoid/test.py::test_upload_s3_fail_upload_part_when_multi_part_upload[gzip] [gw3] PASSED test_attach_without_checksums/test.py::test_attach_without_checksums [gw2] PASSED test_broken_projections/test.py::test_disappeared_projection_on_start test_broken_projections/test.py::test_materialize_broken_projection [gw6] PASSED test_backward_compatibility/test_aggregate_function_state.py::test_backward_compatability_for_uniq_exact_variadic[1000] [gw0] PASSED test_checking_s3_blobs_paranoid/test.py::test_upload_s3_fail_upload_part_when_multi_part_upload[gzip] test_checking_s3_blobs_paranoid/test.py::test_upload_s3_fail_upload_part_when_multi_part_upload[lz4] [gw7] PASSED test_asynchronous_metrics_pk_bytes_fields/test.py::test_total_pk_bytes_in_memory_fields test_backward_compatibility/test_ip_types_binary_compatibility.py::test_ip_types_binary_compatibility [gw0] PASSED test_checking_s3_blobs_paranoid/test.py::test_upload_s3_fail_upload_part_when_multi_part_upload[lz4] test_checking_s3_blobs_paranoid/test.py::test_upload_s3_fail_upload_part_when_multi_part_upload[none] test_backward_compatibility/test_aggregate_function_state.py::test_backward_compatability_for_uniq_exact_variadic[500000] [gw2] PASSED test_broken_projections/test.py::test_materialize_broken_projection test_broken_projections/test.py::test_mutation_with_broken_projection [gw0] PASSED test_checking_s3_blobs_paranoid/test.py::test_upload_s3_fail_upload_part_when_multi_part_upload[none] test_checking_s3_blobs_paranoid/test.py::test_upload_s3_fail_upload_part_when_multi_part_upload[xz] test_backward_compatibility/test.py::test_backward_compatability1 [gw8] PASSED test_backup_s3_storage_class/test.py::test_backup_s3_storage_class [gw0] PASSED test_checking_s3_blobs_paranoid/test.py::test_upload_s3_fail_upload_part_when_multi_part_upload[xz] test_checking_s3_blobs_paranoid/test.py::test_upload_s3_fail_upload_part_when_multi_part_upload[zstd] [gw0] PASSED test_checking_s3_blobs_paranoid/test.py::test_upload_s3_fail_upload_part_when_multi_part_upload[zstd] test_checking_s3_blobs_paranoid/test.py::test_when_error_is_retried[connection_refused] [gw0] PASSED test_checking_s3_blobs_paranoid/test.py::test_when_error_is_retried[connection_refused] [gw3] PASSED test_backward_compatibility/test_ip_types_binary_compatibility.py::test_ip_types_binary_compatibility test_backward_compatibility/test_short_strings_aggregation.py::test_backward_compatability [gw7] PASSED test_backward_compatibility/test.py::test_backward_compatability1 [gw5] PASSED test_azure_blob_storage_native_copy/test.py::test_backup_restore_on_merge_tree_different_container test_azure_blob_storage_native_copy/test.py::test_backup_restore_on_merge_tree_native_copy_async [gw6] PASSED test_backward_compatibility/test_aggregate_function_state.py::test_backward_compatability_for_uniq_exact_variadic[500000] test_backward_compatibility/test_aggregate_fixed_key.py::test_two_level_merge [gw4] PASSED test_backup_restore_azure_blob_storage/test.py::test_backup_restore test_backup_restore_azure_blob_storage/test.py::test_backup_restore_correct_block_ids [gw5] PASSED test_azure_blob_storage_native_copy/test.py::test_backup_restore_on_merge_tree_native_copy_async test_azure_blob_storage_native_copy/test.py::test_backup_restore_on_merge_tree_same_container [gw9] PASSED test_async_insert_memory/test.py::test_memory_usage [gw2] PASSED test_broken_projections/test.py::test_mutation_with_broken_projection [gw5] PASSED test_azure_blob_storage_native_copy/test.py::test_backup_restore_on_merge_tree_same_container test_backward_compatibility/test_memory_bound_aggregation.py::test_backward_compatability [gw4] PASSED test_backup_restore_azure_blob_storage/test.py::test_backup_restore_correct_block_ids test_backup_restore_azure_blob_storage/test.py::test_backup_restore_diff_container test_asynchronous_metric_jemalloc_profile_active/test.py::test_asynchronous_metric_jemalloc_profile_active [gw4] PASSED test_backup_restore_azure_blob_storage/test.py::test_backup_restore_diff_container test_backup_restore_azure_blob_storage/test.py::test_backup_restore_on_merge_tree [gw4] PASSED test_backup_restore_azure_blob_storage/test.py::test_backup_restore_on_merge_tree test_backup_restore_azure_blob_storage/test.py::test_backup_restore_with_named_collection_azure_conf1 [gw4] PASSED test_backup_restore_azure_blob_storage/test.py::test_backup_restore_with_named_collection_azure_conf1 test_backup_restore_azure_blob_storage/test.py::test_backup_restore_with_named_collection_azure_conf2 [gw3] PASSED test_backward_compatibility/test_short_strings_aggregation.py::test_backward_compatability [gw4] PASSED test_backup_restore_azure_blob_storage/test.py::test_backup_restore_with_named_collection_azure_conf2 test_backward_compatibility/test_parallel_replicas_protocol.py::test_backward_compatability [gw8] PASSED test_backward_compatibility/test_aggregate_fixed_key.py::test_two_level_merge [gw9] SKIPPED test_asynchronous_metric_jemalloc_profile_active/test.py::test_asynchronous_metric_jemalloc_profile_active test_block_structure_mismatch/test.py::test [gw7] PASSED test_backward_compatibility/test_memory_bound_aggregation.py::test_backward_compatability test_backup_restore_on_cluster/test_slow_rmt.py::test_replicated_database_async [gw1] PASSED test_backup_restore_on_cluster/test_concurrency.py::test_create_or_drop_tables_during_backup[Atomic-MergeTree] test_backup_restore_on_cluster/test_concurrency.py::test_create_or_drop_tables_during_backup[Lazy-Log] [gw6] PASSED test_backward_compatibility/test_parallel_replicas_protocol.py::test_backward_compatability [gw8] PASSED test_block_structure_mismatch/test.py::test [gw9] PASSED test_backup_restore_on_cluster/test_slow_rmt.py::test_replicated_database_async [gw1] PASSED test_backup_restore_on_cluster/test_concurrency.py::test_create_or_drop_tables_during_backup[Lazy-Log] test_backup_restore_on_cluster/test_concurrency.py::test_create_or_drop_tables_during_backup[Memory-MergeTree] [gw1] PASSED test_backup_restore_on_cluster/test_concurrency.py::test_create_or_drop_tables_during_backup[Memory-MergeTree] test_backup_restore_on_cluster/test_concurrency.py::test_create_or_drop_tables_during_backup[Ordinary-MergeTree] [gw1] PASSED test_backup_restore_on_cluster/test_concurrency.py::test_create_or_drop_tables_during_backup[Ordinary-MergeTree] test_backup_restore_on_cluster/test_concurrency.py::test_create_or_drop_tables_during_backup[Replicated-ReplicatedMergeTree] [gw1] PASSED test_backup_restore_on_cluster/test_concurrency.py::test_create_or_drop_tables_during_backup[Replicated-ReplicatedMergeTree] test_backup_restore_on_cluster/test_concurrency.py::test_kill_mutation_during_backup [gw1] PASSED test_backup_restore_on_cluster/test_concurrency.py::test_kill_mutation_during_backup test_backup_restore_on_cluster/test_concurrency.py::test_replicated_table [gw1] PASSED test_backup_restore_on_cluster/test_concurrency.py::test_replicated_table ============================== slowest durations =============================== 193.50s setup test_backup_restore_azure_blob_storage/test.py::test_backup_restore 168.56s setup test_azure_blob_storage_native_copy/test.py::test_backup_restore_on_merge_tree_different_container 122.77s call test_backup_restore_on_cluster/test_concurrency.py::test_create_or_drop_tables_during_backup[Replicated-ReplicatedMergeTree] 117.21s call test_backup_restore_on_cluster/test_concurrency.py::test_create_or_drop_tables_during_backup[Atomic-MergeTree] 116.83s call test_async_insert_memory/test.py::test_memory_usage 105.82s call test_backup_restore_on_cluster/test_concurrency.py::test_create_or_drop_tables_during_backup[Ordinary-MergeTree] 105.01s call test_backup_restore_on_cluster/test_concurrency.py::test_create_or_drop_tables_during_backup[Lazy-Log] 104.64s call test_backup_restore_on_cluster/test_concurrency.py::test_create_or_drop_tables_during_backup[Memory-MergeTree] 58.85s call test_asynchronous_metrics_pk_bytes_fields/test.py::test_total_pk_bytes_in_memory_fields 57.10s setup test_checking_s3_blobs_paranoid/test.py::test_adaptive_timeouts[node] 48.31s call test_backup_restore_on_cluster/test_concurrency.py::test_concurrent_backups_on_same_node 45.59s call test_alter_moving_garbage/test.py::test_delete_race_leftovers 38.03s setup test_alter_moving_garbage/test.py::test_alter_moving[False-False] 35.38s setup test_backup_restore_s3/test_throttling.py::test_backup_scheduler_settings[0-default] 35.30s call test_broken_projections/test.py::test_broken_on_start 35.28s setup test_attach_backup_from_s3_plain/test.py::test_attach_part[compact0] 35.25s call test_backward_compatibility/test_aggregate_function_state.py::test_backward_compatability_for_uniq_exact[500000] 32.21s call test_backup_restore_on_cluster/test_concurrency.py::test_concurrent_backups_on_different_nodes 31.96s call test_backward_compatibility/test_aggregate_function_state.py::test_backward_compatability_for_uniq_exact[1000] 28.43s call test_broken_projections/test.py::test_mutation_with_broken_projection 27.84s call test_backward_compatibility/test_aggregate_function_state.py::test_backward_compatability_for_uniq_exact_variadic[1000] 27.47s setup test_alter_comment_on_cluster/test.py::test_comment 26.60s call test_broken_projections/test.py::test_broken_projections_in_backups_3 25.78s call test_backward_compatibility/test_aggregate_function_state.py::test_backward_compatability_for_uniq_exact_variadic[500000] 24.68s teardown test_backup_restore_s3/test_throttling.py::test_backup_scheduler_settings[1-s3_no_native_copy] 23.61s teardown test_checking_s3_blobs_paranoid/test.py::test_when_error_is_retried[connection_refused] 23.55s teardown test_alter_moving_garbage/test.py::test_delete_race_leftovers 23.52s call test_broken_projections/test.py::test_broken_ignored 23.41s teardown test_attach_backup_from_s3_plain/test.py::test_attach_part[wide1] 22.09s teardown test_backup_s3_storage_class/test.py::test_backup_s3_storage_class 21.84s setup test_backup_restore_on_cluster/test_concurrency.py::test_concurrent_backups_on_different_nodes 21.19s call test_broken_projections/test.py::test_disappeared_projection_on_start 20.91s call test_backward_compatibility/test_ip_types_binary_compatibility.py::test_ip_types_binary_compatibility 20.47s setup test_backward_compatibility/test.py::test_backward_compatability1 20.17s setup test_backup_restore_on_cluster/test_two_shards_two_replicas.py::test_replicated_table 19.70s call test_broken_projections/test.py::test_broken_projections_in_backups_2 19.57s teardown test_backup_restore_azure_blob_storage/test.py::test_backup_restore_with_named_collection_azure_conf2 18.90s call test_backward_compatibility/test_aggregate_function_state.py::test_backward_compatability_for_avg 18.84s setup test_backward_compatibility/test_aggregate_function_state.py::test_backward_compatability_for_avg 18.71s call test_alter_moving_garbage/test.py::test_alter_moving[True-True] 17.31s setup test_broken_projections/test.py::test_broken_ignored 17.25s call test_alter_moving_garbage/test.py::test_alter_moving[False-True] 17.17s setup test_backup_s3_storage_class/test.py::test_backup_s3_storage_class 16.59s setup test_async_insert_memory/test.py::test_memory_usage 16.24s setup test_attach_without_checksums/test.py::test_attach_without_checksums 15.86s teardown test_azure_blob_storage_native_copy/test.py::test_backup_restore_on_merge_tree_same_container 15.83s setup test_backward_compatibility/test_short_strings_aggregation.py::test_backward_compatability 15.65s teardown test_backup_restore_on_cluster/test_concurrency.py::test_replicated_table 15.35s setup test_accept_invalid_certificate/test.py::test_accept 15.23s setup test_backup_restore_storage_policy/test.py::test_storage_policies[None--default] 14.67s setup test_asynchronous_metric_log_table/test.py::test_event_time_microseconds_field 14.63s setup test_backward_compatibility/test_memory_bound_aggregation.py::test_backward_compatability 14.61s teardown test_backward_compatibility/test_aggregate_function_state.py::test_backward_compatability_for_uniq_exact_variadic[500000] 14.50s setup test_backward_compatibility/test_aggregate_fixed_key.py::test_two_level_merge 14.36s setup test_backup_restore_on_cluster/test_slow_rmt.py::test_replicated_database_async 14.16s call test_backup_restore_on_cluster/test_two_shards_two_replicas.py::test_two_tables_with_uuid_in_zk_path 13.84s setup test_block_structure_mismatch/test.py::test 13.15s teardown test_alter_comment_on_cluster/test.py::test_comment 13.00s call test_checking_s3_blobs_paranoid/test.py::test_upload_s3_fail_create_multi_part_upload[deflate] 12.97s setup test_backward_compatibility/test_parallel_replicas_protocol.py::test_backward_compatability 12.82s call test_checking_s3_blobs_paranoid/test.py::test_adaptive_timeouts[node_with_inf_s3_retries] 12.39s teardown test_backward_compatibility/test_aggregate_function_state.py::test_backward_compatability_for_uniq_exact[500000] 10.78s setup test_asynchronous_metric_jemalloc_profile_active/test.py::test_asynchronous_metric_jemalloc_profile_active 10.74s teardown test_backup_restore_on_cluster/test_two_shards_two_replicas.py::test_two_tables_with_uuid_in_zk_path 10.18s call test_checking_s3_blobs_paranoid/test.py::test_query_is_canceled_with_inf_retries 9.60s teardown test_backward_compatibility/test.py::test_backward_compatability1 9.40s call test_broken_projections/test.py::test_broken_ignored_replicated 9.38s call test_checking_s3_blobs_paranoid/test.py::test_adaptive_timeouts[node] 9.36s call test_alter_moving_garbage/test.py::test_alter_moving[False-False] 8.67s call test_broken_projections/test.py::test_materialize_broken_projection 8.50s teardown test_asynchronous_metric_log_table/test.py::test_event_time_microseconds_field 8.15s call test_checking_s3_blobs_paranoid/test.py::test_node_with_query_log_on_s3 7.84s call test_backup_restore_on_cluster/test_concurrency.py::test_replicated_table 7.75s teardown test_backward_compatibility/test_aggregate_function_state.py::test_backward_compatability_for_avg 7.68s call test_backup_restore_on_cluster/test_concurrency.py::test_kill_mutation_during_backup 7.64s teardown test_backward_compatibility/test_aggregate_function_state.py::test_backward_compatability_for_uniq_exact[1000] 7.57s teardown test_block_structure_mismatch/test.py::test 7.47s call test_alter_comment_on_cluster/test.py::test_comment 7.46s teardown test_asynchronous_metrics_pk_bytes_fields/test.py::test_total_pk_bytes_in_memory_fields 7.29s teardown test_backup_restore_on_cluster/test_slow_rmt.py::test_replicated_database_async 7.10s call test_backup_restore_on_cluster/test_slow_rmt.py::test_replicated_database_async 6.92s call test_checking_s3_blobs_paranoid/test.py::test_upload_s3_fail_upload_part_when_multi_part_upload[gzip] 6.82s teardown test_backward_compatibility/test_aggregate_function_state.py::test_backward_compatability_for_uniq_exact_variadic[1000] 6.69s teardown test_backward_compatibility/test_aggregate_fixed_key.py::test_two_level_merge 6.41s teardown test_attach_without_checksums/test.py::test_attach_without_checksums 6.38s call test_backup_restore_on_cluster/test_two_shards_two_replicas.py::test_replicated_table 6.26s call test_broken_projections/test.py::test_check_part_thread 6.23s teardown test_async_insert_memory/test.py::test_memory_usage 6.22s call test_backup_restore_azure_blob_storage/test.py::test_backup_restore_correct_block_ids 5.77s teardown test_backup_restore_storage_policy/test.py::test_storage_policies[policy1-policy2-policy2] 5.54s call test_checking_s3_blobs_paranoid/test.py::test_when_error_is_retried[connection_refused] 5.36s call test_asynchronous_metric_log_table/test.py::test_event_time_microseconds_field 5.32s teardown test_accept_invalid_certificate/test.py::test_strict_reject_with_config 5.27s call test_checking_s3_blobs_paranoid/test.py::test_upload_s3_fail_create_multi_part_upload[bz2] 5.23s teardown test_asynchronous_metric_jemalloc_profile_active/test.py::test_asynchronous_metric_jemalloc_profile_active 5.01s teardown test_backward_compatibility/test_parallel_replicas_protocol.py::test_backward_compatability 4.97s setup test_asynchronous_metrics_pk_bytes_fields/test.py::test_total_pk_bytes_in_memory_fields 4.81s teardown test_backward_compatibility/test_short_strings_aggregation.py::test_backward_compatability 4.76s teardown test_backward_compatibility/test_memory_bound_aggregation.py::test_backward_compatability 4.72s teardown test_broken_projections/test.py::test_mutation_with_broken_projection 4.65s call test_checking_s3_blobs_paranoid/test.py::test_upload_s3_fail_create_multi_part_upload[gzip] 4.11s call test_checking_s3_blobs_paranoid/test.py::test_upload_s3_fail_upload_part_when_multi_part_upload[lz4] 4.07s call test_checking_s3_blobs_paranoid/test.py::test_exception_in_onFinish 3.84s call test_checking_s3_blobs_paranoid/test.py::test_upload_s3_fail_upload_part_when_multi_part_upload[deflate] 3.81s call test_checking_s3_blobs_paranoid/test.py::test_upload_s3_fail_upload_part_when_multi_part_upload[br] 3.76s call test_attach_without_checksums/test.py::test_attach_without_checksums 3.70s call test_backward_compatibility/test_memory_bound_aggregation.py::test_backward_compatability 3.39s call test_backward_compatibility/test_parallel_replicas_protocol.py::test_backward_compatability 3.30s call test_azure_blob_storage_native_copy/test.py::test_backup_restore_on_merge_tree_same_container 3.27s setup test_backward_compatibility/test_ip_types_binary_compatibility.py::test_ip_types_binary_compatibility 3.25s call test_checking_s3_blobs_paranoid/test.py::test_upload_s3_fail_create_multi_part_upload[lz4] 3.20s call test_checking_s3_blobs_paranoid/test.py::test_upload_s3_fail_upload_part_when_multi_part_upload[xz] 2.80s call test_checking_s3_blobs_paranoid/test.py::test_upload_s3_fail_create_multi_part_upload[br] 2.69s call test_checking_s3_blobs_paranoid/test.py::test_upload_s3_fail_upload_part_when_multi_part_upload[zstd] 2.65s call test_checking_s3_blobs_paranoid/test.py::test_upload_s3_fail_upload_part_when_multi_part_upload[none] 2.62s call test_backward_compatibility/test_short_strings_aggregation.py::test_backward_compatability 2.62s call test_checking_s3_blobs_paranoid/test.py::test_upload_s3_fail_create_multi_part_upload[none] 2.52s call test_azure_blob_storage_native_copy/test.py::test_backup_restore_on_merge_tree_different_container 2.51s call test_azure_blob_storage_native_copy/test.py::test_backup_restore_on_merge_tree_native_copy_async 2.49s call test_checking_s3_blobs_paranoid/test.py::test_upload_s3_fail_upload_part_when_multi_part_upload[bz2] 2.27s call test_backup_restore_storage_policy/test.py::test_storage_policies[None-policy1-policy1] 2.26s call test_checking_s3_blobs_paranoid/test.py::test_no_key_found_disk 2.14s call test_checking_s3_blobs_paranoid/test.py::test_upload_s3_fail_create_multi_part_upload[xz] 2.10s call test_checking_s3_blobs_paranoid/test.py::test_upload_s3_fail_create_multi_part_upload[zstd] 1.96s teardown test_backup_restore_on_cluster/test_two_shards_two_replicas.py::test_replicated_table 1.89s call test_backup_restore_azure_blob_storage/test.py::test_backup_restore_diff_container 1.86s teardown test_backward_compatibility/test_ip_types_binary_compatibility.py::test_ip_types_binary_compatibility 1.85s call test_backward_compatibility/test_aggregate_fixed_key.py::test_two_level_merge 1.79s call test_backup_restore_storage_policy/test.py::test_storage_policies[policy1-policy1-policy1] 1.74s call test_backup_restore_azure_blob_storage/test.py::test_backup_restore 1.71s call test_backup_restore_storage_policy/test.py::test_storage_policies[None-None-default] 1.67s call test_backup_restore_storage_policy/test.py::test_storage_policies[policy1-policy2-policy2] 1.67s call test_backup_restore_s3/test_throttling.py::test_backup_scheduler_settings[1-s3_no_native_copy] 1.66s call test_backup_restore_s3/test_throttling.py::test_backup_scheduler_settings[0-default] 1.66s call test_backup_restore_azure_blob_storage/test.py::test_backup_restore_on_merge_tree 1.58s call test_backup_s3_storage_class/test.py::test_backup_s3_storage_class 1.56s call test_backup_restore_storage_policy/test.py::test_storage_policies[None--default] 1.51s call test_backup_restore_storage_policy/test.py::test_storage_policies[policy1-None-policy1] 1.50s call test_backup_restore_azure_blob_storage/test.py::test_backup_restore_with_named_collection_azure_conf2 1.46s call test_backup_restore_s3/test_throttling.py::test_backup_scheduler_settings[0-s3_no_native_copy] 1.46s call test_backup_restore_storage_policy/test.py::test_storage_policies[policy1--default] 1.46s call test_backup_restore_s3/test_throttling.py::test_backup_scheduler_settings[1-default] 1.42s call test_attach_backup_from_s3_plain/test.py::test_attach_part[compact0] 1.37s call test_backup_restore_s3/test_throttling.py::test_backup_scheduler_settings[1-s3_native_copy] 1.34s call test_backup_restore_s3/test_throttling.py::test_backup_scheduler_settings[0-s3_native_copy] 1.30s call test_attach_backup_from_s3_plain/test.py::test_attach_part[wide0] 1.25s call test_backup_restore_azure_blob_storage/test.py::test_backup_restore_with_named_collection_azure_conf1 1.23s teardown test_backup_restore_on_cluster/test_concurrency.py::test_concurrent_backups_on_different_nodes 1.12s call test_checking_s3_blobs_paranoid/test.py::test_upload_after_check_works 1.00s teardown test_backup_restore_on_cluster/test_concurrency.py::test_concurrent_backups_on_same_node 0.96s call test_backward_compatibility/test.py::test_backward_compatability1 0.89s teardown test_backup_restore_on_cluster/test_concurrency.py::test_create_or_drop_tables_during_backup[Replicated-ReplicatedMergeTree] 0.80s call test_attach_backup_from_s3_plain/test.py::test_attach_part[wide1] 0.79s teardown test_backup_restore_on_cluster/test_concurrency.py::test_create_or_drop_tables_during_backup[Atomic-MergeTree] 0.75s call test_attach_backup_from_s3_plain/test.py::test_attach_part[compact1] 0.73s teardown test_backup_restore_on_cluster/test_concurrency.py::test_kill_mutation_during_backup 0.70s call test_block_structure_mismatch/test.py::test 0.63s teardown test_backup_restore_on_cluster/test_concurrency.py::test_create_or_drop_tables_during_backup[Ordinary-MergeTree] 0.63s teardown test_backup_restore_on_cluster/test_concurrency.py::test_create_or_drop_tables_during_backup[Memory-MergeTree] 0.58s teardown test_backup_restore_on_cluster/test_concurrency.py::test_create_or_drop_tables_during_backup[Lazy-Log] 0.38s teardown test_backup_restore_storage_policy/test.py::test_storage_policies[None-policy1-policy1] 0.37s setup test_checking_s3_blobs_paranoid/test.py::test_upload_s3_fail_create_multi_part_upload[zstd] 0.30s setup test_checking_s3_blobs_paranoid/test.py::test_upload_s3_fail_create_multi_part_upload[bz2] 0.27s call test_accept_invalid_certificate/test.py::test_connection_accept 0.26s setup test_checking_s3_blobs_paranoid/test.py::test_upload_s3_fail_create_multi_part_upload[gzip] 0.25s setup test_checking_s3_blobs_paranoid/test.py::test_upload_s3_fail_upload_part_when_multi_part_upload[lz4] 0.22s teardown test_backup_restore_storage_policy/test.py::test_storage_policies[policy1-policy1-policy1] 0.22s call test_asynchronous_metric_jemalloc_profile_active/test.py::test_asynchronous_metric_jemalloc_profile_active 0.22s call test_accept_invalid_certificate/test.py::test_strict_reject 0.22s call test_accept_invalid_certificate/test.py::test_accept 0.22s teardown test_backup_restore_storage_policy/test.py::test_storage_policies[None--default] 0.22s teardown test_backup_restore_storage_policy/test.py::test_storage_policies[policy1--default] 0.22s call test_accept_invalid_certificate/test.py::test_strict_reject_with_config 0.22s call test_accept_invalid_certificate/test.py::test_default 0.20s setup test_checking_s3_blobs_paranoid/test.py::test_node_with_query_log_on_s3 0.20s setup test_checking_s3_blobs_paranoid/test.py::test_upload_s3_fail_create_multi_part_upload[deflate] 0.20s setup test_checking_s3_blobs_paranoid/test.py::test_upload_s3_fail_create_multi_part_upload[br] 0.17s teardown test_backup_restore_storage_policy/test.py::test_storage_policies[None-None-default] 0.17s call test_accept_invalid_certificate/test.py::test_strict_connection_reject 0.17s teardown test_backup_restore_storage_policy/test.py::test_storage_policies[policy1-None-policy1] 0.15s setup test_checking_s3_blobs_paranoid/test.py::test_upload_s3_fail_upload_part_when_multi_part_upload[gzip] 0.15s setup test_checking_s3_blobs_paranoid/test.py::test_upload_s3_fail_upload_part_when_multi_part_upload[zstd] 0.14s setup test_checking_s3_blobs_paranoid/test.py::test_query_is_canceled_with_inf_retries 0.13s setup test_checking_s3_blobs_paranoid/test.py::test_upload_after_check_works 0.13s setup test_checking_s3_blobs_paranoid/test.py::test_no_key_found_disk 0.13s setup test_checking_s3_blobs_paranoid/test.py::test_upload_s3_fail_upload_part_when_multi_part_upload[deflate] 0.11s setup test_checking_s3_blobs_paranoid/test.py::test_upload_s3_fail_create_multi_part_upload[none] 0.11s setup test_checking_s3_blobs_paranoid/test.py::test_exception_in_onFinish 0.10s setup test_checking_s3_blobs_paranoid/test.py::test_upload_s3_fail_create_multi_part_upload[lz4] 0.10s setup test_checking_s3_blobs_paranoid/test.py::test_adaptive_timeouts[node_with_inf_s3_retries] 0.09s setup test_checking_s3_blobs_paranoid/test.py::test_upload_s3_fail_upload_part_when_multi_part_upload[bz2] 0.09s setup test_checking_s3_blobs_paranoid/test.py::test_upload_s3_fail_upload_part_when_multi_part_upload[br] 0.08s setup test_checking_s3_blobs_paranoid/test.py::test_upload_s3_fail_create_multi_part_upload[xz] 0.08s setup test_checking_s3_blobs_paranoid/test.py::test_when_error_is_retried[connection_refused] 0.07s setup test_checking_s3_blobs_paranoid/test.py::test_upload_s3_fail_upload_part_when_multi_part_upload[none] 0.07s setup test_checking_s3_blobs_paranoid/test.py::test_upload_s3_fail_upload_part_when_multi_part_upload[xz] 0.01s teardown test_broken_projections/test.py::test_broken_projections_in_backups_2 0.01s teardown test_checking_s3_blobs_paranoid/test.py::test_adaptive_timeouts[node] 0.01s setup test_backward_compatibility/test_aggregate_function_state.py::test_backward_compatability_for_uniq_exact_variadic[1000] 0.00s teardown test_broken_projections/test.py::test_broken_ignored 0.00s setup test_broken_projections/test.py::test_check_part_thread 0.00s teardown test_alter_moving_garbage/test.py::test_alter_moving[True-True] 0.00s setup test_backward_compatibility/test_aggregate_function_state.py::test_backward_compatability_for_uniq_exact[500000] 0.00s teardown test_alter_moving_garbage/test.py::test_alter_moving[False-True] 0.00s teardown test_broken_projections/test.py::test_broken_projections_in_backups_3 0.00s teardown test_checking_s3_blobs_paranoid/test.py::test_adaptive_timeouts[node_with_inf_s3_retries] 0.00s setup test_alter_moving_garbage/test.py::test_alter_moving[True-True] 0.00s teardown test_backup_restore_azure_blob_storage/test.py::test_backup_restore 0.00s setup test_backup_restore_on_cluster/test_concurrency.py::test_concurrent_backups_on_same_node 0.00s teardown test_checking_s3_blobs_paranoid/test.py::test_upload_s3_fail_create_multi_part_upload[deflate] 0.00s teardown test_broken_projections/test.py::test_broken_on_start 0.00s setup test_backup_restore_on_cluster/test_concurrency.py::test_create_or_drop_tables_during_backup[Atomic-MergeTree] 0.00s setup test_backup_restore_on_cluster/test_concurrency.py::test_kill_mutation_during_backup 0.00s setup test_backward_compatibility/test_aggregate_function_state.py::test_backward_compatability_for_uniq_exact_variadic[500000] 0.00s setup test_backup_restore_on_cluster/test_concurrency.py::test_create_or_drop_tables_during_backup[Lazy-Log] 0.00s teardown test_azure_blob_storage_native_copy/test.py::test_backup_restore_on_merge_tree_different_container 0.00s setup test_backward_compatibility/test_aggregate_function_state.py::test_backward_compatability_for_uniq_exact[1000] 0.00s setup test_alter_moving_garbage/test.py::test_delete_race_leftovers 0.00s teardown test_checking_s3_blobs_paranoid/test.py::test_upload_s3_fail_create_multi_part_upload[br] 0.00s setup test_broken_projections/test.py::test_materialize_broken_projection 0.00s setup test_broken_projections/test.py::test_broken_ignored_replicated 0.00s setup test_broken_projections/test.py::test_broken_projections_in_backups_2 0.00s teardown test_broken_projections/test.py::test_disappeared_projection_on_start 0.00s setup test_broken_projections/test.py::test_broken_projections_in_backups_3 0.00s teardown test_checking_s3_blobs_paranoid/test.py::test_query_is_canceled_with_inf_retries 0.00s teardown test_alter_moving_garbage/test.py::test_alter_moving[False-False] 0.00s teardown test_attach_backup_from_s3_plain/test.py::test_attach_part[compact0] 0.00s setup test_attach_backup_from_s3_plain/test.py::test_attach_part[compact1] 0.00s setup test_backup_restore_storage_policy/test.py::test_storage_policies[policy1-policy1-policy1] 0.00s teardown test_backup_restore_s3/test_throttling.py::test_backup_scheduler_settings[0-default] 0.00s setup test_attach_backup_from_s3_plain/test.py::test_attach_part[wide1] 0.00s setup test_azure_blob_storage_native_copy/test.py::test_backup_restore_on_merge_tree_native_copy_async 0.00s setup test_backup_restore_storage_policy/test.py::test_storage_policies[policy1--default] 0.00s teardown test_broken_projections/test.py::test_materialize_broken_projection 0.00s setup test_backup_restore_on_cluster/test_concurrency.py::test_create_or_drop_tables_during_backup[Ordinary-MergeTree] 0.00s setup test_backup_restore_on_cluster/test_concurrency.py::test_replicated_table 0.00s setup test_backup_restore_on_cluster/test_two_shards_two_replicas.py::test_two_tables_with_uuid_in_zk_path 0.00s setup test_backup_restore_storage_policy/test.py::test_storage_policies[policy1-None-policy1] 0.00s setup test_backup_restore_storage_policy/test.py::test_storage_policies[None-policy1-policy1] 0.00s setup test_backup_restore_azure_blob_storage/test.py::test_backup_restore_correct_block_ids 0.00s setup test_alter_moving_garbage/test.py::test_alter_moving[False-True] 0.00s setup test_backup_restore_on_cluster/test_concurrency.py::test_create_or_drop_tables_during_backup[Memory-MergeTree] 0.00s setup test_backup_restore_s3/test_throttling.py::test_backup_scheduler_settings[0-s3_native_copy] 0.00s setup test_backup_restore_s3/test_throttling.py::test_backup_scheduler_settings[0-s3_no_native_copy] 0.00s setup test_backup_restore_on_cluster/test_concurrency.py::test_create_or_drop_tables_during_backup[Replicated-ReplicatedMergeTree] 0.00s setup test_attach_backup_from_s3_plain/test.py::test_attach_part[wide0] 0.00s setup test_broken_projections/test.py::test_broken_on_start 0.00s setup test_backup_restore_azure_blob_storage/test.py::test_backup_restore_diff_container 0.00s setup test_backup_restore_storage_policy/test.py::test_storage_policies[policy1-policy2-policy2] 0.00s setup test_backup_restore_storage_policy/test.py::test_storage_policies[None-None-default] 0.00s setup test_backup_restore_s3/test_throttling.py::test_backup_scheduler_settings[1-default] 0.00s teardown test_checking_s3_blobs_paranoid/test.py::test_upload_s3_fail_upload_part_when_multi_part_upload[deflate] 0.00s teardown test_checking_s3_blobs_paranoid/test.py::test_upload_s3_fail_create_multi_part_upload[gzip] 0.00s setup test_backup_restore_s3/test_throttling.py::test_backup_scheduler_settings[1-s3_native_copy] 0.00s setup test_backup_restore_s3/test_throttling.py::test_backup_scheduler_settings[1-s3_no_native_copy] 0.00s teardown test_attach_backup_from_s3_plain/test.py::test_attach_part[wide0] 0.00s setup test_backup_restore_azure_blob_storage/test.py::test_backup_restore_on_merge_tree 0.00s teardown test_checking_s3_blobs_paranoid/test.py::test_upload_s3_fail_create_multi_part_upload[xz] 0.00s teardown test_checking_s3_blobs_paranoid/test.py::test_upload_s3_fail_upload_part_when_multi_part_upload[zstd] 0.00s teardown test_checking_s3_blobs_paranoid/test.py::test_upload_s3_fail_create_multi_part_upload[zstd] 0.00s teardown test_checking_s3_blobs_paranoid/test.py::test_upload_s3_fail_upload_part_when_multi_part_upload[xz] 0.00s teardown test_broken_projections/test.py::test_check_part_thread 0.00s teardown test_backup_restore_azure_blob_storage/test.py::test_backup_restore_on_merge_tree 0.00s teardown test_backup_restore_s3/test_throttling.py::test_backup_scheduler_settings[0-s3_native_copy] 0.00s setup test_backup_restore_azure_blob_storage/test.py::test_backup_restore_with_named_collection_azure_conf1 0.00s teardown test_backup_restore_azure_blob_storage/test.py::test_backup_restore_with_named_collection_azure_conf1 0.00s teardown test_checking_s3_blobs_paranoid/test.py::test_node_with_query_log_on_s3 0.00s setup test_backup_restore_azure_blob_storage/test.py::test_backup_restore_with_named_collection_azure_conf2 0.00s teardown test_checking_s3_blobs_paranoid/test.py::test_upload_s3_fail_upload_part_when_multi_part_upload[lz4] 0.00s teardown test_checking_s3_blobs_paranoid/test.py::test_upload_after_check_works 0.00s setup test_azure_blob_storage_native_copy/test.py::test_backup_restore_on_merge_tree_same_container 0.00s setup test_broken_projections/test.py::test_mutation_with_broken_projection 0.00s teardown test_attach_backup_from_s3_plain/test.py::test_attach_part[compact1] 0.00s teardown test_backup_restore_azure_blob_storage/test.py::test_backup_restore_diff_container 0.00s teardown test_checking_s3_blobs_paranoid/test.py::test_exception_in_onFinish 0.00s teardown test_checking_s3_blobs_paranoid/test.py::test_upload_s3_fail_create_multi_part_upload[lz4] 0.00s teardown test_checking_s3_blobs_paranoid/test.py::test_upload_s3_fail_upload_part_when_multi_part_upload[none] 0.00s teardown test_checking_s3_blobs_paranoid/test.py::test_upload_s3_fail_upload_part_when_multi_part_upload[gzip] 0.00s setup test_accept_invalid_certificate/test.py::test_strict_connection_reject 0.00s setup test_accept_invalid_certificate/test.py::test_default 0.00s teardown test_checking_s3_blobs_paranoid/test.py::test_upload_s3_fail_create_multi_part_upload[none] 0.00s teardown test_azure_blob_storage_native_copy/test.py::test_backup_restore_on_merge_tree_native_copy_async 0.00s setup test_broken_projections/test.py::test_disappeared_projection_on_start 0.00s setup test_accept_invalid_certificate/test.py::test_strict_reject_with_config 0.00s setup test_accept_invalid_certificate/test.py::test_strict_reject 0.00s setup test_accept_invalid_certificate/test.py::test_connection_accept 0.00s teardown test_backup_restore_s3/test_throttling.py::test_backup_scheduler_settings[1-s3_native_copy] 0.00s teardown test_backup_restore_s3/test_throttling.py::test_backup_scheduler_settings[0-s3_no_native_copy] 0.00s teardown test_accept_invalid_certificate/test.py::test_accept 0.00s teardown test_checking_s3_blobs_paranoid/test.py::test_upload_s3_fail_upload_part_when_multi_part_upload[bz2] 0.00s teardown test_checking_s3_blobs_paranoid/test.py::test_upload_s3_fail_create_multi_part_upload[bz2] 0.00s teardown test_checking_s3_blobs_paranoid/test.py::test_upload_s3_fail_upload_part_when_multi_part_upload[br] 0.00s teardown test_backup_restore_s3/test_throttling.py::test_backup_scheduler_settings[1-default] 0.00s teardown test_backup_restore_azure_blob_storage/test.py::test_backup_restore_correct_block_ids 0.00s teardown test_broken_projections/test.py::test_broken_ignored_replicated 0.00s teardown test_checking_s3_blobs_paranoid/test.py::test_no_key_found_disk 0.00s teardown test_accept_invalid_certificate/test.py::test_strict_connection_reject 0.00s teardown test_accept_invalid_certificate/test.py::test_connection_accept 0.00s teardown test_accept_invalid_certificate/test.py::test_strict_reject 0.00s teardown test_accept_invalid_certificate/test.py::test_default =========================== short test summary info ============================ PASSED test_accept_invalid_certificate/test.py::test_accept PASSED test_accept_invalid_certificate/test.py::test_connection_accept PASSED test_accept_invalid_certificate/test.py::test_default PASSED test_accept_invalid_certificate/test.py::test_strict_connection_reject PASSED test_accept_invalid_certificate/test.py::test_strict_reject PASSED test_accept_invalid_certificate/test.py::test_strict_reject_with_config PASSED test_backup_restore_storage_policy/test.py::test_storage_policies[None--default] PASSED test_backup_restore_storage_policy/test.py::test_storage_policies[None-None-default] PASSED test_backup_restore_storage_policy/test.py::test_storage_policies[None-policy1-policy1] PASSED test_backup_restore_storage_policy/test.py::test_storage_policies[policy1--default] PASSED test_backup_restore_storage_policy/test.py::test_storage_policies[policy1-None-policy1] PASSED test_backup_restore_storage_policy/test.py::test_storage_policies[policy1-policy1-policy1] PASSED test_backup_restore_storage_policy/test.py::test_storage_policies[policy1-policy2-policy2] PASSED test_attach_backup_from_s3_plain/test.py::test_attach_part[compact0] PASSED test_backup_restore_s3/test_throttling.py::test_backup_scheduler_settings[0-default] PASSED test_attach_backup_from_s3_plain/test.py::test_attach_part[compact1] PASSED test_backward_compatibility/test_aggregate_function_state.py::test_backward_compatability_for_avg PASSED test_backup_restore_s3/test_throttling.py::test_backup_scheduler_settings[0-s3_native_copy] PASSED test_attach_backup_from_s3_plain/test.py::test_attach_part[wide0] PASSED test_attach_backup_from_s3_plain/test.py::test_attach_part[wide1] PASSED test_backup_restore_s3/test_throttling.py::test_backup_scheduler_settings[0-s3_no_native_copy] PASSED test_broken_projections/test.py::test_broken_ignored PASSED test_backup_restore_s3/test_throttling.py::test_backup_scheduler_settings[1-default] PASSED test_backup_restore_s3/test_throttling.py::test_backup_scheduler_settings[1-s3_native_copy] PASSED test_backup_restore_s3/test_throttling.py::test_backup_scheduler_settings[1-s3_no_native_copy] PASSED test_alter_moving_garbage/test.py::test_alter_moving[False-False] PASSED test_broken_projections/test.py::test_broken_ignored_replicated PASSED test_backup_restore_on_cluster/test_concurrency.py::test_concurrent_backups_on_different_nodes PASSED test_backup_restore_on_cluster/test_two_shards_two_replicas.py::test_replicated_table PASSED test_alter_moving_garbage/test.py::test_alter_moving[False-True] PASSED test_checking_s3_blobs_paranoid/test.py::test_adaptive_timeouts[node] PASSED test_backup_restore_on_cluster/test_two_shards_two_replicas.py::test_two_tables_with_uuid_in_zk_path PASSED test_backward_compatibility/test_aggregate_function_state.py::test_backward_compatability_for_uniq_exact[1000] PASSED test_checking_s3_blobs_paranoid/test.py::test_adaptive_timeouts[node_with_inf_s3_retries] PASSED test_alter_moving_garbage/test.py::test_alter_moving[True-True] PASSED test_checking_s3_blobs_paranoid/test.py::test_exception_in_onFinish PASSED test_broken_projections/test.py::test_broken_on_start PASSED test_checking_s3_blobs_paranoid/test.py::test_no_key_found_disk PASSED test_asynchronous_metric_log_table/test.py::test_event_time_microseconds_field PASSED test_checking_s3_blobs_paranoid/test.py::test_node_with_query_log_on_s3 PASSED test_backup_restore_on_cluster/test_concurrency.py::test_concurrent_backups_on_same_node PASSED test_checking_s3_blobs_paranoid/test.py::test_query_is_canceled_with_inf_retries PASSED test_broken_projections/test.py::test_broken_projections_in_backups_2 PASSED test_checking_s3_blobs_paranoid/test.py::test_upload_after_check_works PASSED test_checking_s3_blobs_paranoid/test.py::test_upload_s3_fail_create_multi_part_upload[br] PASSED test_checking_s3_blobs_paranoid/test.py::test_upload_s3_fail_create_multi_part_upload[bz2] PASSED test_backward_compatibility/test_aggregate_function_state.py::test_backward_compatability_for_uniq_exact[500000] PASSED test_alter_comment_on_cluster/test.py::test_comment PASSED test_checking_s3_blobs_paranoid/test.py::test_upload_s3_fail_create_multi_part_upload[deflate] PASSED test_alter_moving_garbage/test.py::test_delete_race_leftovers PASSED test_broken_projections/test.py::test_broken_projections_in_backups_3 PASSED test_checking_s3_blobs_paranoid/test.py::test_upload_s3_fail_create_multi_part_upload[gzip] PASSED test_checking_s3_blobs_paranoid/test.py::test_upload_s3_fail_create_multi_part_upload[lz4] PASSED test_broken_projections/test.py::test_check_part_thread PASSED test_checking_s3_blobs_paranoid/test.py::test_upload_s3_fail_create_multi_part_upload[none] PASSED test_checking_s3_blobs_paranoid/test.py::test_upload_s3_fail_create_multi_part_upload[xz] PASSED test_checking_s3_blobs_paranoid/test.py::test_upload_s3_fail_create_multi_part_upload[zstd] PASSED test_checking_s3_blobs_paranoid/test.py::test_upload_s3_fail_upload_part_when_multi_part_upload[br] PASSED test_checking_s3_blobs_paranoid/test.py::test_upload_s3_fail_upload_part_when_multi_part_upload[bz2] PASSED test_checking_s3_blobs_paranoid/test.py::test_upload_s3_fail_upload_part_when_multi_part_upload[deflate] PASSED test_attach_without_checksums/test.py::test_attach_without_checksums PASSED test_broken_projections/test.py::test_disappeared_projection_on_start PASSED test_backward_compatibility/test_aggregate_function_state.py::test_backward_compatability_for_uniq_exact_variadic[1000] PASSED test_checking_s3_blobs_paranoid/test.py::test_upload_s3_fail_upload_part_when_multi_part_upload[gzip] PASSED test_asynchronous_metrics_pk_bytes_fields/test.py::test_total_pk_bytes_in_memory_fields PASSED test_checking_s3_blobs_paranoid/test.py::test_upload_s3_fail_upload_part_when_multi_part_upload[lz4] PASSED test_broken_projections/test.py::test_materialize_broken_projection PASSED test_checking_s3_blobs_paranoid/test.py::test_upload_s3_fail_upload_part_when_multi_part_upload[none] PASSED test_backup_s3_storage_class/test.py::test_backup_s3_storage_class PASSED test_checking_s3_blobs_paranoid/test.py::test_upload_s3_fail_upload_part_when_multi_part_upload[xz] PASSED test_checking_s3_blobs_paranoid/test.py::test_upload_s3_fail_upload_part_when_multi_part_upload[zstd] PASSED test_checking_s3_blobs_paranoid/test.py::test_when_error_is_retried[connection_refused] PASSED test_backward_compatibility/test_ip_types_binary_compatibility.py::test_ip_types_binary_compatibility PASSED test_backward_compatibility/test.py::test_backward_compatability1 PASSED test_azure_blob_storage_native_copy/test.py::test_backup_restore_on_merge_tree_different_container PASSED test_backward_compatibility/test_aggregate_function_state.py::test_backward_compatability_for_uniq_exact_variadic[500000] PASSED test_backup_restore_azure_blob_storage/test.py::test_backup_restore PASSED test_azure_blob_storage_native_copy/test.py::test_backup_restore_on_merge_tree_native_copy_async PASSED test_async_insert_memory/test.py::test_memory_usage PASSED test_broken_projections/test.py::test_mutation_with_broken_projection PASSED test_azure_blob_storage_native_copy/test.py::test_backup_restore_on_merge_tree_same_container PASSED test_backup_restore_azure_blob_storage/test.py::test_backup_restore_correct_block_ids PASSED test_backup_restore_azure_blob_storage/test.py::test_backup_restore_diff_container PASSED test_backup_restore_azure_blob_storage/test.py::test_backup_restore_on_merge_tree PASSED test_backup_restore_azure_blob_storage/test.py::test_backup_restore_with_named_collection_azure_conf1 PASSED test_backward_compatibility/test_short_strings_aggregation.py::test_backward_compatability PASSED test_backup_restore_azure_blob_storage/test.py::test_backup_restore_with_named_collection_azure_conf2 PASSED test_backward_compatibility/test_aggregate_fixed_key.py::test_two_level_merge PASSED test_backward_compatibility/test_memory_bound_aggregation.py::test_backward_compatability PASSED test_backup_restore_on_cluster/test_concurrency.py::test_create_or_drop_tables_during_backup[Atomic-MergeTree] PASSED test_backward_compatibility/test_parallel_replicas_protocol.py::test_backward_compatability PASSED test_block_structure_mismatch/test.py::test PASSED test_backup_restore_on_cluster/test_slow_rmt.py::test_replicated_database_async PASSED test_backup_restore_on_cluster/test_concurrency.py::test_create_or_drop_tables_during_backup[Lazy-Log] PASSED test_backup_restore_on_cluster/test_concurrency.py::test_create_or_drop_tables_during_backup[Memory-MergeTree] PASSED test_backup_restore_on_cluster/test_concurrency.py::test_create_or_drop_tables_during_backup[Ordinary-MergeTree] PASSED test_backup_restore_on_cluster/test_concurrency.py::test_create_or_drop_tables_during_backup[Replicated-ReplicatedMergeTree] PASSED test_backup_restore_on_cluster/test_concurrency.py::test_kill_mutation_during_backup PASSED test_backup_restore_on_cluster/test_concurrency.py::test_replicated_table SKIPPED [1] test_asynchronous_metric_jemalloc_profile_active/test.py:30: Disabled for sanitizers ================== 99 passed, 1 skipped in 698.15s (0:11:38) ===================